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ABSTRACT r A 

Using inte^iews, observation, and archival ^""^ 
documents, researchers traced, the 4-year' iiistory of a "freestanding" 
interorganizational arrangement for schaol improvement in Santa Clara * 
County (California). Called the "AB 65 Elementary Consortium," the 
' interdistrict collaboration was started in rerspon'se to California ' 
Assembly- Bill .(AB) 65, which jnandates tests of elementary students' 
basic skills proficiencies. The proficiency testing consortium was ^ 
"freestanding" in that member organizations contributed all the 
resources r ^ ^ired. Established in 1S77, t he coiisoi L lmu began 



developing gui^delines for proficiency tffests, had a setback in early 
1979 when its first te'sts (prepared by consultants) prov^ to be of 
poor quality*, but retrenched and succeeded in publishing^ts own 
testing products in 198b-81. The tests chiefly measured math, 
reading, and writing competencies in grades 4, 6, and 8. Consortium 
membership grew from 12 districts and agencies in 1978''to.33 in 1980 
and fell, back to 25 in mid-1981. Important in th^ consortium's^^ ^ 
development were its sources^ aod uses of services and informati^ 
the role of the S^nta Clara County Superintendent of Schoals, afid 
districts' local control over their own participation. An appendix 
provides data on the consortium and documents relating to its 
formation and products. (RW) 
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This case study represents a portion-^of a larger effort, SMpported 
by the Research and Educational Pract.ice Unit of t'he National Insti- 
tute of Education, td develop a more c5mpre4iensi ve understanding of 
-how vaHous types of educational organizations relate to one another 
.in accomplishing school' improvement projects. In a^ previous study* . 
we identified, described, and analyzed the. characteristics of 103 
interor'ganizational arrangements (lOAs) Involving educational agencies 
that were fouiid in.th'e 13 counties of the'Greater San Francisco Bay 
Area; Several unexpected findings ^rged from this study* First 
was the lar*ge number of arrangements identified. Second was the fre- 
quency with which educational organizations participated in arrange- 
ments: the range of frequency was between one "and 18 arrangements; ^ 
67 percent .of the 409'educ$tional agencies identified participated in 
tv/o or more arrangements. Third, ;all of the 231 Bay Area school dis- 
tricts were engaged in at least one arrang4ment, and 90 percent were 
. in two or more. These findings indicate much more frequent formal 
connection among educatiortel organizations than has been previously 
assumed or identified. , ^ \ 

A two-dimensional, nine-cell classif icatiorr system v/as developed to 
classify the arrangements. ' One dimension considered the legal status 
of the arrangement itself (mandated, enabled, or freestanding) and , ' . 
the second dimension considered the legal sta^tus of the improvement 
effort that the arrangement supported (mandated, enabled, or free- 
stanjding). Wjien the 103 arrangements were classified- by .this two- 
dimensional ^system, no arrangements were found'for two of the nine 
, swbclasses: a.) -mandated arrangement suppor*flng a freestanding school 
improvement effort and b)* enabled arrangement supporting a freestand- 
ing improvement effort.,. Only 14 .percent of the arrangements were ' 
freestanding ^rrnagem'ents supporting freestanding improvement efforts. 
The remaiilirvg 86 percent of the arrangements were focused on support- 
in^mandated or enabled improvement efforts, and ov.er three-fourths 
of the 103 .arrangements Ijelonged 'jto- one of the four classes in which 
there, was' jo^nt exterji.al •influence, mandated or enabled, on both the 
arrangement i'tself andUhe §chool improvement effort the arrangement 
supported.* 



* ^ C.$. Gates, P.D. Hood, and S.' McKib^in', An Exploration of Inter- 
. ' organizationaT Arr^gements that Support School Imprgvement . San 
r Francisco, '^CA: Fa> West Laboratory for Educational fJ-esearch and • 
Develo^Qient, 1?(8U;/ ' ^ , ' ' - 
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However, 10 of .theJ03 arrangements had the interesting* characteristic 
of being .freestanding arrangements (In which merfiber organizations con- 
tributed all. of the resources of the arrangement and for which there 
was no s'igrtJf.icant external requirement provided) that were voluntarily 
formed by educational agencies to,support school improvement efforts 
that were themselves mandated (four lOAs) or enabled (six-IOAsJ. AlV 
four of the free6tandjng arrangements supporting^ mandated improvement,^ 
efforts were Proficiency Testing Consortia* 

This case study describes one of these ProficiencV Testing' Consortia* 
,We have made'a special effort to/describe this l^nrticular arrangement 
'fiot only to provide more detailed infoHnation about this type of lOA, 
but also-because this type of arrangement provides a highly promising 
model for successful collaboration among school districts that *are- 4 
confronted with requirements that may'severely tax their individual 
resourc>^ The case study alsp demonstrates the importance of effec- 
tive arganizational leadersljip (-in this case provided by a county 
school's office) and .significant participation and "ownership" on t+ie 
, part of member organizations* ' . ^ ' " / ^ ^ 

This case study documents the major events that oc^urred.^witHin this 
interorganizational arrangement, where the members went for- services 
and information, ^nd how this knowledge was used. The costs' *and bene-' 
fits, responsibilties and rewards of consortium activity emerge- as 
the* case unfolds over a four-year time frame. ^ / ' 

Paul D. Hood I ' 

Educational Dissemination Studies 'Program * " 
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THE^^CASE STUDY 



Introduction . * 

InterorganizationaT arrangements (lOAs)', like the organization^ 
that*comprise them, cTiange 'dramatically over time*o After they are 
established, they experiment, grow, and .stabil ize* Then they decline 
and disappear or^^re altered in some form. In^t^Pd€tions among member 
organizati5*ns chang^.|as dQ their contributions/ Information resources 
and k'Wowledge inputs vary to reTlect the redefined needs and purposes 
of the JOA. There can be starts and stops, de^tours, dead ends, /con- 
flicts, dtsappoint^ients, and dropotft^. These in turn can'be pffset 
b^ reduced costs, intrinsit a^^d extririsjc rewards for ttte represen- 
tatives, well -developed products or services, and strong, healthy 
relationships among member organizatiorTs. 

This case study of the AB 65 Elementary Consortium established in 
SBnta Clara Coifnty,' -Cal ifornia^ will trace the history, products and- 
processes of the consortium .frdin the^ time it was no. more than an idea, 
in a 1977 memorandum. Since then, i.t^has sponsored the development - 
of competencies, performance indicators, and item banks In reading, 
wrtting,.^nd mathematics for grades*4, 6,^ and 8. Its products also 
Include guidelines-for scoring writing samples and an administrator s 
notebook for meeting the requirements o'f AB 65. The consortium has 
sought help from staff at the Office. of the Santa Clara County 'Super- 
'intendent of Schools and qther county offices, the California State 
Department of Education (CSDB) , pri vate^educatiorfal testing and^con- ^ 
suiting firms, member districts, ^and other sources. The ijnpressive 
^list of valuable products is proof positive >tbat collaboration can be 

^ K f . 



cost-effective and -^<;ie^nt^d^ toward results* The esprit' de corps and 
active involvement of the consortium membfers uoderscore the other, 
less tangible benefits of working together* 

Santa CI &ra County ' ' 1. * ^ 

Santa Clafa County begins at^ the^southern end of thp San Francisco 
^^^^J^ peninsula and extends inland through metropolitan 'and rural areas* - 
Varied socioeconomic and^ultural conditions exiS^, exemplified ^y the 
"Silicon Valley" electronics and computer manofcfcturers slotting the 
nprthern part of the county and the ^^^nEs^^growi ng produce in the rich 
soil to the south. Small* suburban communities have developed around 
San ^ose, the lar-gest cUy in the county,* San Jose has a substantial 
Hispanic popuTatip'n and other less dominant minorities^ , The Office 
of -the Santa Clar-a County/Super'intendent, of Schools serves 22 elemen- 
t^ary districts, five high school districts, and six unified districts. 

• ' The Legfslative fjandate • 

California State Assembly Bill 65 (AB 65) mandated that each 
elementary school district should- assess the turrent^basic skills 
achievement of its students to determine if^they have reached) the 
level of competency expected^by the district* Elementary boards of 
education were required^ by law to ^adopt a set of competencies in 
reading comprehension, writing, and computation for grades 4-6 and 
7-8 by June 1, 1979* The local board^was also required to establish 

- • > "■ - ' • . . ' 

proficiency standards with the involvement of parents, "administrators, 
teachers, and counselors. The legislation Emphasized the assessment 
. of each pupiVs mastery 'bf the basic skill s». rather than the pupil's 
performance relative to his or her classmates. 



A companion bill, AB 3408, required that after June 1980, high , 
school students^unable to meet locally prescribed standards in the 
three Basic skills b"^ refused a diploma, 'The law'established an 
"early warning sy^fem" that requires competency testing beginning • • 
once in grades 7-9 and conducted twice i*n grades 10 and 11/ A con- 
ference between the school principal or a designee, the student, a 
parent oV guardian, and -a teacher must be held if the student fails tlo— 

meet>the prescribed standards. After^the conference, instruction in 

• • . * 

basic skills must be provided untjl the student has been given/ 

repeated opportunity to achieve, the standards'. 

Both California laws allow indi^^idukl districts to establish thei^ 

own proficiency assessment standards. Districts may also decide which 

specific competencies will be tested and how, thisj^l Jbe done. Some 

districts hav^ decided to u^e standardized tests; others ^have chosen 

to develop their own measurement instruments. Some have met the require' 

ment on their own; others have join^ a cooperative effort aimed at meet 

ing the legal requirements as completely and efficientfy as possible. 

Early Discuss.ions of the Consortium ^ ^ • ^ 

Twenty-two people from Santa Clara County school districts and 
the county office attended a meeting on Oct/oer 19, 1977 "to deter- 

¥ ^ 7 ^ 

mine [the] value, need , -[and] feasibil ity/of forming a consortium of 
districts to implement ^he instructional/implications of AB 65." 
Elemejitary- school districts and IJieiy boards of education were required 
to adopt a set of competencies for ^radps 4-6 and 7-8 by June 1, 1979/ 
The impetus for tlie meeting came inTtially from the Assistant Superin- 
tendents of Instruction of the eleragntary school districts, who meet ^ 



regul-arly at^ the county office. Already a con^rtium of county 
districts serving, the secondary level had been^establishek to form- 
ulate the materials and procedures necessary t(k place ba'Sic skills, 
proficiency assessments^^^member districts by the June 1980 deadline. 
Mayte something similar would be beneficial for elementary districts 
as well. .. . - • . 

At the meeting; Wcfrnings were .aired by thos? skeptical about the ^ ^ 
ability of a consortiums to meet, i^ndividual district needs. Discussion 
^ejnphasized the fact that minimum standards would vary from district 
.to district; it mi^W: also be^more difficult to arMculate elementary 
standards >/ith those at the high school level if a' consortium were 
involved. But by the end of the meeting, there was general agreement 
that a cooperative effort would 'be desirable. The county office wa^ 
asked to clarify in writing what it was proposing to the districts. 
A task force of I'ive volunteers was formed to develop recommendations 
. for working together as a consortium. 

The following week* the task force met with three staff members 
froni the county office to discuss i^ues related to the establishment 
of a consortium. Some of their concerns were based on t\]^ fact that ^ 
a few districts had already established basic skills competency continua 
and had ar;ticulated tft^r programs with the high schools. They did 
not want to be put in a .posifton af revising or renegotiating what 
was already in*place. • • ^ 



^ ' " One task force member pr'esented-a plan supporting the tdea of a 
proficiency assessment consortium. He argued th*at the joint cpntri-^ 
but ions of membV districts would result in a pool^ of objectives and 
items as well as\omputer servic^es that none of the districts alone 
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dould afford. He also suggested that -the members" would be more able 
to introduce alternative instructional approat:hes using the products 
developed by a' consorti um. .\ 

* By the end of .the meeting, t^e county office had agreed to con- 
.duct an.^rientation to the AB 65 legislation for elementary dostricts 
in the county/ The county offide would, also .calculate a cost estimate 
far the development of feasic skills objectives and item pools. The 
task force had assigned itself seven activities related to the devel- 
opment of competencies, objectives, scoring processes, reporting pro- 
cedures, and instructional models. Based on the ^ork of th^ task force, 
needed workshops and consultant help would be identified. 

Here we . see, then, that by'Octofcier 1977 there was enCLugh .inter- 
est on the part af some local -^nd" county education agency staff to 
clarify the services that a consortium could support "and what it would 
cost. School districts were. facing a g1ven--a legislatively mandated 
basic sklTls proficiency assessment for grades 476 and^-S. Compli- ^ 
ance with the- directive was not optional, although how, districts weint , 
about doing so waSt .Ty/o asswnptions informed some of the. early thtnk- 
ing about the consortium:^ _ ^ 

^. 'The functions, purposes, and fosts of the collaborative^effort 
should be specified, and^* • ^ ^ ^ 

•2. Information and' reso.urcfes frd(?i outside the consortium would be^ 
necessaicy to, complete the tasks. 

• ^ ■ / '^ — 

Establishment of the Consortium ^ 

January 1978 marked the next round. of organtzati^al. meetings " 
of the "Elementary' ABaSB pounty Group." ATI elementary districts 
were invited tosend^representatives to a meeting to discuss the 



'budget 'draft prepared by the County Director of Guidanc^iimg Vocational 
• Education, ^ho'was spearheading. the effort* The possibili^of con- 
solidati-ng the elementary and high^school consortia was al^o discussed. 
• Supporting the consolidation, some argued that it would ^frtiance infor-'. 
matioh sharing, cut ^sts^ increase staff development activity, and 
serve ttie. "political" function of answering critics more effectively. 
^, On the negative side, others 'suggested that the size would prove too 
' cumbersome^ for ^ef feet ive communicatioi>, that\bere would be less moti- 
vation to cooperate, that money would not be saved, and that art iculation ^ 

/ 

. was already occurring locally anyway, v Eventually a decision was made .to 
"set up both consortia and "get together periodically." 

Three county office staff members (the Assistant. Superintendent of 
Instructional Services, the Director of General Education Services, and 
/ the Director of Guidance and Vocational. Education) met during February 
and March 1978 tp discuss the role of 'their agency in the consortium 
effort. Four thousand dollars would be provided by the county office 
to pay a consultant to work -on basic ski'lls comptetency statements 
and performance indicators. Staffing assistance would also be available 
from the county .off icel District representatives would be trained t^ 
use theJ'Alameda process" at the local level. (Devised .by the'Alameda 
[California] County Office of Educatioa^-this group process wauld * 
enable individual districts to generate competency statements and 
^performance standards appropriate to their educational programs.) 

The thinking at tJie time ran so: ^After all this had beer>. accom- 
pltshed, teachers would write the necessary test items and develop the^ 
test instrgments. The county office would sponsor a series of work-- 
shops to train teachers from member districts In test ^ preparation. 

^ it 



It was also proposed that the consortium could work with the California 
State Department of Education to field test the teacher-developed 
items during' falM978* ' ^ ^ 

On April 10, 1978t a*meeting of elementary district reprp&enta- 
,tive§ was held at which the county office formally proposed the estatT- • 
lishment of an Elementary AB ^5 Consortium* The consortium activities 
previously discussed by county office staff were ^proposed to the grpup, 
along with the estimate tt^t assessment packages Qould be developed' 
by July 1, 1978'-at a cost of $45,000» This would demand district 
fiscal contributions* 

Speakifig ait a later meeting of district Assistant Superintendents 

for Instruction, the County Assistant Superintendent stated that "the 

finished product will address mandates of state legislation in a way 

<#' * ^ 

that assures local [and] county ownership, validity and reliabil- 

ity***and [also assures, that school districts] can adapt their in^truc- 

, - - ? 

tional prqgrams' diagnostic procedures to the competencies in ways 
they best see, fit/' During April, the consortium was formally estab- 
lished, and by June, sixteen school districts and twq, universities ' ^ 
were participating with the county office in the consortium. • 

Initiating' the Work «^ 

In April, the county office hired a^'consultant to the consortium 
to provide specific resources anci services as rapidly as possible. 
Reading, writing, and math meetings were scheduled^ i/i May for discussion 
of the possible^constraints and benefits of minimum competency assess- 
ment in each area. Competency statements for, the three basic skills 




were also written *a:t the^neeti ngs.. A JuiTO memorandum from the con- 
'Sultant to 'consortium members suggested *^ new timelihe for t'he devel-. 
opment of an assessment -.package bySeptember 1979. 

Not much was accpmplished during the summer of 1978. In fact, a 
memorandum to consortium members announcing the upcoming September 
meeting began, "This is a follow-up ef our letter of June 7, 1978 to 
remind yo\j that the AB 65 E^lnentary" Consort i um is still in existence." 
The same memorandum propi>^d two methods of accomplishing the necessary 
■consortium tasks during the upcoming school year. The first was to 
obtain money from districts and the county o-f^fi^ "to hire a consul- 
tant group to develop performance indicators and select items." The 
second alternative was *'tt3' have e^ch'of -the 'districts and the county 
office identify at *least ^ne person who could devote 10 full working 
^ays" to the^tasks at hand. , . * 

Formalizing Consortium Merjibership an3 Laying Grdundwork 

Twenty people attended the September meeting. The first agenda 

^ ^ , ^^^^ 

itan was ttiscussion about whether or not the consortiuni should con- 

y - 

tinue. Up to^this point>nt^e districts had not-contributed any finan- 
cial' resources- to the support of the consortium. The county office 
.had done what it could by hiring a consultant to work from April to 

* 

June on some consort iuffl'Tt^sks. But the entii^e process was moving 
^much too slowly. Jt v^as. eyident that a considerable amount of human 
or* financial resources, Wou'ld' be needed if the group was going to meet 
the legislative mandate »by the deadline. 

Did*the members agree to continue the consortium? They did, 

\ ' ■ 

despite "confusion about the purpose of the Consortium and hov/ it 



woulcKmsure district/community involvement." The group felt that 
• \ "only by consortium activity could the law's deadlines be met." f 
Those present requested^that a letter be sent'frfom the county office 
to memb^ districts explaining the products to be developed, the 
. process that would be followed, th€\minimum number of districts 
necessary, the tinleU-ne,* and the reason for the decision to work at 
the sixth-grade level first* ^ ^ - ^ 

The letter was sent on^October 2, 1978 to all elementarjt dis- 
trict administrators* Attached was a Qpnsortium W^ork Agreement Form, 
'establishing each district* s contribution to the consortium at $500* 
^ By f^ovember, 11 work agreements had been signed and returned. In^ 
order to .helj) meet the goal of ^20 members, the group agreed to 
allow 'dIstrieU outsidet, Santa Clara, County to join the consortium*-^ 

2^^embers] so that / 



They stated, "The hope is that we will 
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district contributi.pns ($500 each) Wfll total $10,000 .to equal the 
contribution from tlie.^county offip^e." 

The understanding that it would be necessary to hire a group 
' of outside consultants to develop an;l field test the sixth-grade 
assessment package was implicit in the "discussions at the November 

meeting. The .County Director, of Vocational Education and Guidance, 

^' " 

who had been coordinating most of the consort iui]^ effort from the ^ 

*^ 

. outset, developed a. "Request for Propos-al .and mailed it to potential 
/contractors. Two committees were formed to screen the proposals 
and interview the candidates. ^ % * 

By the December meeting, only oae bidder had responded to the ' 
RFP, and there* wefe some questions about the -adequacy of' the -bid.* 
The County Vocational Edycatiorv Director agreed to negotiate with 
the bidderto .assVF^that the nec^ssary^work would be accomplished. 

. ■ ' 17* 
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Retrospective on the First Year , , ' 

A review of the/devel opmental effort that began ia October?" 
1977 and continued through December 1978 is in order at this. point. ' % 

1 ' 

Tentative beginnings punctuated the initiation of the consortium. 
Districts did not y^t seem^ to feel any urgency to work toward meeting 
the AB 65 mandate. If it were nbt for the unflagging interest arxi 
staunch belief oi the County Office tn the benefits of consortium 
activity, it is doubtful *that a collaborative effort would have- 
^ . \' been organized by the districts themselves. Although at this stage 
\ the elementary districts did nqt seem opposed to the consorti^im, 
they w6re not particularly enthusiastic about it, either. Their ^ 
attitude seemed to be, ''*lf the county office thinks it's such a good 
IdBa, we may as well go along with it. The investment of resources 
is^^j^nimal compared to the potential IJenefits of meeting the legisla- 
tive^mandate as* expediently as possible." , ' ' 



It is evident here, then, that the county office's leadership 
\ jrole was becoming increasingly important to the creation of ifie con- 
^ sortium. Staff at the county office had coordinated coQsortium 
activity from the beginning, calling meetings, mailing written ctShi- 



munications to elementary districts, and documenting what v(as occilr^ring. 

/ ' ' . ' " ' X) 

The agency had paid for a consultant to serve the consortium auring 

- 19/8. The districts in the consortium were^looking to county offic^ 
staff for tbe guidance and impetus* needed to keep the group together. 

What.infoonaj^i on-gathering and knowledge use activities occurred 
^during these early months of the consortium's existence? Tbe county 

* off icei received information about the legislation- from the State 
Department of Eduction, as did the school districts. They all seemed 

to ^ 
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to be aware^^that although expertise within a district or consortium 
might be ^sufficient to put a local proficiency assessment in place, ^it 
would probably be necessary to go outside for some ^servic^s such as 
scoring.- - . - ^ • ^ ^ 

The consortium enabled outside consultants to be used more readily 
than they would have been used by individual districts^ First, the 
financial resources. contributed by the consortium^ members 4nd the 
county office were greater than^most districts would have had available^ 
And second, a more thorough process of developing competencies, per- 
formance indicators and itertis and of writing, field testing, and 
^alyzing assessment instruments would be possible. \t seemed .to be^ 
a simple matter of deciding what needed to be done and hiring outside 
consultants to do- the work. M the end of .19Ja approached, the ^ 
consortium was ready to contract with a consulting firm to develop ' / 
and pilot test sixth-grade as^^ssment items. ' . 

' .Other sources of information ^and assistance were the Alameda 
County Office of Edu^ion, which provided the training materials and 
activities for the "Alameda process," and the secondary consortium in 
Santa Clara County. Little attempt was made' by consortium members tO; 
do extensive research -in basic skills content areas or testing and 
measurement. • 

A Period of Faltering * . J - ^ 

January 1979 began the serious work of the consortiujn. It had 
a budget of over $15V000 and a consulting firm to prepare the sixth- 
grade assessment instrument and pilot test it within a tight timeline. 
The target dates proved to be too tight, iif fact. The only serious - 
problem in the history of the consortium was about^ tb present itself.^ 



' V Originally, the ''consulting finh hired .to develop and pilot test' 
the sixth-grade items had' schedul ed field testihcf for t^e fourth week 
' in February, Each 'di strict was to have some degree of involvement in 
the pilot.,te$ting. A Test Admini stration 'iraini ng Session for dis- 
trict representatives was scheduled for February 21, after which thds 
individuals had^less than a\week to train the teachers who would be 
giving the tests in their classes. In January it was^nat yet appar- 
ent^wha't problems were about to unfold. 

.In fact, the"February 1979 consortium meeting was only periph- 
erally concerned With the upcoming pilot testing. The group was busy 
collecting samples of board policies and reciprocity -agreements 

• V 

responding to tl>e 65 legislation. "They discussed assessment pro- 
cedures other than written tests and began th<inking about a^lternative 
instructional approaches keyed to 'ba^ skills compeir^hcies. \ The Bay 
Area Writing Committee would be approacheS^o see if it cpuid pro- 
vide volunteers *to train teacher 'to score *^^he writing samples n 
obtained in the >pilot test. Each district was asked to name someone 
to serve on the-writing scoring committee. | 

The pilot testing was completed. Rumblings about the quality 
of the work done by the consultant group had npt yjet begun.^ -The 
March me^eting v/as devoted to concerns about refining competencies 
and performance indicators and di sl'emioating (Tampl e board policy 
statements to member districts. The consultant responsibl-e for the 
pilot testing distributed printouts of the (jiath data and reviewed * - 
It with the consortium. /There is no tndicatfon in the. records of 
the March meeting that problems with the pilot testing were mentioned 
or discussed,. . • 



The April mating, however, was another matter. ^ A^-new 'county 
office Coordinator ior Guidance and^Tesxing assigned °tb work with the 
consortium, coordinator had collated comments made by^the -teachers who 
had scored the writing competency test. 'They werfe'.devastating: 

"One of the warst 'standardized* tests J' ve -run into." 

"The scoring is invalid because it Vs obvfous that the i 
tests were administered under widely vaYying conditions." 

"Directions for students on indiv4dual .items were not 
j complete enough and grammatically incorrect!!" 

"Part II was a waste of time. PaVt III was a total loss." 

Co'mments from teachers, we're extensive' and highly critical. There 

seemed to be very little positive that could^be said for the writing 

test. , . ■ ■ ■ 

Mi.nutes»from the April meeting provide a candi'd record of the ^ 
• * *■ 

discussion. ^ 

Jhe group felt that the test had been thrown ^ toget^^rj^* 
m a Tiurry...tThere was some doubt about thfe test specifi- 
catio/i criteria" and test performance criteria that were used 
' in selecting the items, the feeling was that it would be 
hard to give the reasons why certain items appeared in the - 
test^ Varioiteij^^jiiembers of the consortium said tha't they got 
angry calls/fom teachers about the level of 'the items and 
the expectations. The callers did not .feel the tests were* 
appropriate as functional comge^ency tests. Part^of the . 
problems in getting materials on time and part of'the foul- 
'ups in testing had .to be assigned to an almost impossible 
. timeline to get the viprk done. ' 

^ The Problem was both, critical .and embarrassing. The consor- 

tium^^sT first visible product had been harriedly developed by outside 

consultants whose activities and materia] s had not been. monitored or 

reviewed by any member of the consortium. In their haste to sfee some 

results, fhe necessary checks and balances had not b6en built into the . 



'^process* Everyone apparently a^ssumecl ^that because "experts" had 
bean hired to do the job, there was nothing more for the consortium 
to do but wait for the'printouts p-f fi el detest results* 

t 

Analysis of Possible Causes of the firoblem 

T-his is an excellent example of the perspective that pervaded 
^ the consortium in its early stages pf development* The group h&d'not 
.yet ge*nerated th^ sense of ownership it needed in order to, function 
as the final arbiter of the work it sponsored* Further, itd'id not. 
ha.ve sufficient cohesivehess for its members to be willing to work 
hard together on task forces rather than relaying on external experts 
who were isolated from the consortium itself* Everyone seemed to r 
feel that obtaining results was* simply a function of paying someone*'" ' 
to do the wor)<. Cooperation from the districts did not go beyond 
what was necessary for the actual pilot testing. 

Certainly not all of the responsibility- for the pilot testing 
difficulties can be prlaced #t the shoulders X)f the outside consultants* 
There were some internal organizational issues that the consortium 
needed to face and some assumptiions that- should have been challenged* 
The April meeting provided an opportunity for evaluating where the 
consortium was and for planning next steps. : The minutes note, "There 
was an expressrion on the part of s0me of the" districts that they 

- / - 

might not want to continue witti a' consortium next year? but no district 
indicated that [it] had made a decision to drop out at this, point." 
It was clear that if the group did not become more organized and 

4 

effective by the beginning of the 1979-80 school year, some districts 
would n.o longer be members. 

2 



Retrenchment and Reorganization • , ^ ' 

.Another significant change was initiated at the April mei&t^ng. 



Recently hired, the new, Coordinator for tSuidance, and Testing at -the 

N 

county office was beginning to become more involved .in consortium 
activities. He had assembled the teacher comments on the writing 
pilot test ^ and was assigned to work with a consortium committee to 
obtain feedback from districts about .test items. In addition,* he and 
a consortium representative had attended a tw()-w6ek workshop on item 
development sponsored by the State Department of Education. Both 
were available to help districts develop assessrrjent fTia4:erta1s related 
to AB 65. This new coordinator was* to play«a Significant role in the - 
success of^ the co'nsortium, as the case ciescription will point out 
later. * 

Some netrenching was going on at the couniy office as^well. 
Thank-you letters were mailed to those who'participated in the pilot 
testing, providing an opportunity to apologize for the "unreaTi stic- 
ally tight timeline." The letters were straightforward,, thoughtful, 
and gracious. One^of them ended, "We hope the results will prove .to 
be worth the effort, time, and criticism you received because of our 
logistics problems." In adxlition, six "Sip "and Crunch" lunch meet- 
ings for county office staff were scheduled during March, Apj^il , andr 
May 1979»" These "brown baggers" were suggested because "a concern has 
been expressed that the right hand doesn't know what the left is 
really doing [regarding] AB 65 implementation within and without the 
, Instructional Division. "^ The coiinty office was activety trying to 
enhance infonmation sharing among its staff and to smooth, ruffled 
feathers outside tne' agency. 



During May and Jujie, consortium task forces working on performance 
indicators reported their progress and had their recojjimended -Changes 

approved by the group* The Coordinator far Testing and Guidance had 

* 

written a tiraft of. an AB 65 board policy statement, which was amended 
by the consortium. and distributed to its members* LocaT board adop- 
tions of compe/encies and performance indicators were proceeding welK 

Because it was agreed that a second p'i->1ot test would have to be 
conducted in the faM, the county office offered to C9ntribute $4,750 
in Title IV-B money to pay consultants fo work on the proficiency 
assessment package* Some of the consultants selected were active 
representatives 'on the consortium and had ^already invested a' great 
deal in the work of the group. 

Before the summer recess, the consortium voted tQ continue oper- 
atfons during the 1979-80 5f:h^l year. , It suggestedlhat $500 be 
again contributed by each member district. ^ 

Turning a Negative into a Positive 

Perhaps the most significant turnins^point in the development of 

the consortium occurred inr the summer of *79. During these summer^ 

months, the future course of the consortium was charted and ma.de more 

secure. A number of factors contributed to this evolution: 

§ The Coordinator for Guidance and Testing moved into the pos4tion 
of consortium coordinator. He. initiated a cdncerte'd effort to 
^ accomplish^ some ^sks'so that progress would be evident by -the- 
new school year. 

# The consultants hired with Title IV-6 monies were prolific. All 
of these individuals were affiliated with school districts i'n 
the county, and somte 'served as consortium representatives. They 
worked hard, developing a large binder of products that were di^- 
,tributed at the August meeting. 
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• More accurate budget figures werfe developed by the new ^consortium * 
coordinator. He was able to determine that the proposecl $500 
per-dlstrict contribution for the upcoming year would fall $4,000 

/ * short of the^cpst'of the second round of pilot testing. Rather 
than move ahead with, an^insuff 'icient budget, be asked the districts 

* for an additional $20Creach. This was the first time the district 
contribution had been based on a thorough planning and budgeting 

- process. ' ' - 

We see, then, that the county office put an individual into a strong 
leadership role and provided the-money for products to be developed 
by inside rs--not outside experts.' The strategy was successful. 

The August 1979 meeting was quite different from the ones that 
preceded it that spring. An array of products were distributed 
along withv^reaction sheets for comments from the member districts. 
The price of $1,25,0 was set. for any new^dlstrict wanting to jain the 
consortium during the 1979-80 school year. And for* those washing only 
ta purchase the "consortium package," the price was scaled from $V,000 
to $2,500, depending on the size of the district. To protect its* 
models and materials, the consortium agreed to copyright its products. 

The. August meeting marked the end of the initiation or "muddling 
through" phase of the consortium and the beginning of * a more stable 
pertoci. The group finally had materials that were u^ful to member 
districts and valuable to those outside the consortium. The interor- 
ganizational arrangement had something to justify its existence and 
nurture its growth. 

Publ icity^and' expansion of materials and services became new 
concerns* for thQ consortium. The transformation from a faltering, 
tentative, loosely linked group to a cohesive, product-oriented 
collection of districts occurred during the six months between April 
and October 1979. After October, the consi>f1:ium's activities adopted 
ya different perspective: 



i^ji . ' OPT 
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• A. publicity package was mailed to northern and central California 
districts tq market the sixth- grade items and the Proficiency 
Assessment Specifications Samples^ (PASS) ^Manual developed to go . 
with them* Alth9ugh the consortium could not officially sell its^ 

' products for a -profit, ft could use the money tp suppbrt further 
V developmental efforts." -.^ 

The- PASS Manual was sent to the s-tate* s^ Assistant Chief of the 
Office ot Program Eval.uatio'n and Research at his request* /It-' 
was accompanied by the stipulation that the state agency respect 
the copyright and not disseminate the publication. Further, *any 
sharing of the materials with legislative or political figures 
wa5 to, be done jointly byHhe assistant chief and a representative 
-of the county office. * ■ - . 

• The consortium decided to spend $500 to sponsor the development ^ 
of a Title IV-C grant proposal to be created jointly -wifh the 
secondary consortium to support and expand their materials develop 
ment projects.' The proposal was written and submitted but was 

riot funded because it was judged to .be not "innovative" enough. 

• Additional v^rkshops -were provided at the request of the consor-' 
tium. One' insertice. session on how to score writing samples 

was enthu'siastical ly received by the group. Others on topics 
such as proficiency assessment of special education students 
and setting standards for passing scores were also conducted. 

# 

• Companies providing scoring services gave a presentation at a con- 
sortium meeting. JJistricts began to cooperate^extensi vely on the* 
preparation, prinung, and scoring of their sixth-grade field 
tests. In addition, the districts involved in full-scale prof i- 
ciency tests sharped their item analysis data with the consortium. , 

• A consultant was hfred to do an item review for the sixth-grade 
pilot test. The purpose of the review was "to identify those * 
items which [were] absolutely unacceptable and eliminate them 
from the bank." 

All of this activity was costing money, however, and the.consor- 
tium faced a deficit of $1,200 by the end of. January 1980. Further 
developmental work on sixth-grade items was still necessary, at a * . 
projected cost of $6,000. To complete the sixth-grade package bV 
June, the consortium voted to assess all members an additional $3^0 
and to issue another work agreement to the districts. 

f 



A<lditiona1 Redefinition and Reorgaaization 

Here the,gr*up reached a juncture marked by a rrvpber of reali- 
zations. A year a-fter .the. cohsortiHim'had pi ahne(l-.-Q4' completing -the 

* * • . ' ' %. * ' 

sixth-grade proficiency test, -it wa^' still uafiftishea^ Th^goals of 
the consortium required a considerably -greater jnyestment of time,, 

effort and money than anyone had realized. -GetUfi'g the>^orlc,c}one 

' " ' ' 

was not simply a matter of collecting a small amount of money from . 

each melpbgr and paying an outsider to do ^e ji)b.,- Each school dis- 
trict was much more involved in the proceiss, requiring inservice . 
workshops on subjects such as standard- setting, sciJ^ing writing sam- _ 
pies, find test administration. Their considerable accompl i'sliments came 
slowly and after a significant investment. '^^^ 

The consortium members had a ftumber of options. They coulc^ 
reduce their work load, request additional money from distr^icts and 
oth-er funding sources, begin contributing more of their own time^ 
to necessary activities, expand the^membership, or enter' into .a coop- 
erative Arrangement with another consortiugi or agency for mutOally-t. 
beneficial ends. One key factor was in the consortium's favor.. The- 
county office's Coordinator for Guidance and Jesting had assumed the 
.leadershfp of the.consortfum and was managing it in a' way ?fiat wgs 
"^getting results and motivating thejm^^ As decision points 
arose, the consortium Reorganized.^ 

• It began relyi ng_.more'on task .forc^* composed of its own memb'e^ 
•to "do much of the work. Eventually the consortium established^ 
requirement that every member serve on at least one^task force 
throughout the year. The group, then, begaa looking more within 
itself for information and Services, rath^er than rejying on outside, 
experts. ^\ • . 



• .Item devielbpmeat .and pilot testing at the sixth-grade level had 
'required a disproportionate amount of time and effort. T|iis orig- 
inal deV^elopmen^ effort had taken over a year to accomplish. Other 
tasks', such as formtrlating competencies and performange 'indicators ^ 
, fX)r reading, writing, arid mathematics, could be accomplished effi- 
ciently by^the consortium itself; but an alternative to original 
test item development had to be fou nd before work orKt^ upcoming 
F o u rt h^y -a nd eiyhlh- grade profiClferW^ tests couid Begin. 



• Hiring educators/from within the county to serve as consultants 
had alre^ proven to be an effecti-ve way of developing products 

' and materials. Perhaps using insiders in the same way they were 
employed during the summer of '79 would enhance progress ^ven J J 
more. 

Nurturing and Maintaining the Consortium 

• 1980 brought -the advent of a new approach to assigning responsi- 
bility for completing consortium priorities. Task forces contributed 
„significantly to the output of .the group.- Cooperative printing and 
scoring of assessment instruments was selected as an alternative by some 
Of the districts. Insiders paid by the consortium V/ere exceptionally 
prolific. And a private testing firm with an extensive. item bank, 
helped streamline the item development and field testing process that 
previously had been so time-consuming. Each of these alternatives 
will be described briefly as thejTmanifested themselves after January 
1980. ' ^ ' . • • 

Ta$k' Forces . A variety *of task forces composed of district rep- 
resentatives to tTie consortium produced a considerable ^mount of work 
beginning in 1980. Listed here are some of the functions performed 
by these committees: 

• Developed^ model tests for the sixth grade in reading, writing, and^^ 
mathematKS. , * ~\ ' 

• Recommended whether or not IJie consortium should purchase item banks . 
from Northwest Evaluation Association; 'recommended policy assurances 
to protect copyrighted materials and sixth-grade items ^^1 ready 
produced 'by the consortium* 



• 21 • • , 

• Reported to the consortium on how current priorities could be accom- 
' plished. ^ ^ ^ , , 

• Planned the assessment for grades 4 and 8. . ' 

t Developed alternative means of curriculum and management reUted to 
.the basic skills by coll e cting samples and^bullding q modeU^^ 

§• Collected and diss.eminated item data from districts tnatVhad con- 
ducted the sixih-gi^ade assessment. ^ 

t Developed and finalized test designs for grades 4 and 8. 

t Negotiated new requests for membership and set membership costs. 

• Reviewed the possibility of racial or ethnic test bias and developed 
procedures for reporting suspect_^items to the consortium. 

• 'Decided on the conditiDnsTunder which a university could jqin the 
consortium.' ' 

This list provides ample evidence that task forces played "^a- sig- 
nificant role in moving the consortium ahead in Its activ-ities. But 
all of this investment of time came not without its share of prodding. 
At the June 1980 meeting, only eight_0yt^f 30 consortium members were 
present. The minutes state, "Attendance, commitmentr and participa- 
tion of districts at consortium and*task force meetings has become a 
problem." The group felt that every representative should partici- 
pate in at least one task fflfce. One person suggested that a fine bp 
charged for- inactivity on the j^rt of a district representative. The. , 
consortium decided at the Augirst 1980 meetilig to require every fnember 
to serve on one task force throughout the year. 

But by October, the problem stilTwas not resolved. Two members 
"voiced strong feelings of concern about those who were an the task 
forces- but were not participating. The result was that the Burden 
Of work fell oq^tlje few who were participating--when it should be^ 
more evenly spread." Discussion resulted in an effective solution. 

Or) 



Task ^forces began meeting for an hour and a half before each regu- 
larly scheduled consortium meeting* ^Attendance improved,^ and no more 
complaints were forthcpming. 

Consultants * Two consul tai^ were hired by the consortium during 
1980-81iq|^ One individual ,^whOv^ad worked at ^a county school district 
for a number of years, was h>red repeatedly to provide comprehensive 
service on various *tasks for the' consorti um. He developed ^nd field 
tested additional sixth-grade items In all three basic skills areas. 
Afterwarc|, he put the s^ix'th-*grade item banks on 5x8 cards and distributed 
them to consortium members, providing themivith a training session on 

how test instruments could be developed from the cards. 

J, ^ « * 

Another individual, who had served as a district representative^ 
in the consortiunl arfd had worked as a consultant to the group in the 
summer 1979, was asked in'August 1980 to do spme additional work. Y't^ 
The task force establ ishej^ to d^evelop competencies for the fourth and 
•eighth grades had not met thdt summer, failing to complej^e its assigned 
task. /The consul tant developed a matSrix of competencies and perform- 
ance indicators for grades 4 and 8 based on the existing. sixth-grade 
and secondary standafdls. - 

The first consul t^t mentioned became involved in the competency 

0 

and performance indicatoi: Work during fall 1980, and continued working 

'on it throughout th§ schaol year. He distributed a draft of articulated 

^ . " . ' t , . . ' * ' • . 

competencies and performance Indicators in grades 4 and 8 J'or districts 

to review and crit^ique. Later he agreed to"" develop a product entitled - 

Articiilation o^ Basic Conipetencies, Grades 4 - Secondary . Finally, he 

helped devel6p thfe Administrator's Information Manual (AIM), a note-^ . 

book for administr'ators involved in implementation of the profic*iency ^ 
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assessment mandate. Assisted by task forces, he was able to provide 
the comprehensive investment of time necessary to accomplish the - 
assigned^'^ctsks. 

Purchasing Item Bcinks > 'The considerable drain of time and^money 
that the si)Vtfjrgrade Jtem* bank rgqtSred has already been di bussed. 
Along the. way, the consortium learned 'that item development and . 
validation was not as easy as it might have seemed earlier. So when^ 
Northwest Evaluation Association approached the group with an offer 
to sell its i,t em banks, the cotisortium gave the option thoughtful 
consrideration. A task fofce working with the secondary consortium 
recommended that the consortia purchase the reading and rnathematics 
items for a total of $1,000. The cost would be shared*by both con- 
sortia. A consultant was hired to develop a procedure, to identify 
the items in the,;bank that fit the competencies and performance 
indicators establtshed for grades 4 and 8. In June 1981, thereon- 
sortium agreed to- enter into a reciprocal trade agreement with North- 
west. The/consortiqm would hava^ccess to, the 10,000 items in the 
Northwest bank, and Northwest would be allowed to add the sixth-grade 
Items developed by '^the^ cons.orti um. . _ ' • 

Here we se6, then, that for a mere $500, with an equal contribu- 
tion from the se,concfary consorti um, ^the elementary group was able to 
obtain reading and mathematics *^i terns that fit their specif icatians for 
the fourth- thrD^ugh eighth-grade assessments^ This was a considerably 
smaller investment "than the sixth-grade item bank had required. 'Working 
with an outside company':that had already developed teH items thus 
resulted in'cost-cutting. Starting from scratch and using internal 

-expertise rnay-^ l>e tlje best way to. accomplish some tasks, but item^^ _^ 

* * 
development seemed not to be one ol^them. 
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. Inservice Training and Storkshops . The coasortium requested 
workshop's whenever its members felt that they needed additional 
information -about a topic. Some of the inservice training sessions 
cpnducted 'especially for consortiuoi members are listed here: 

• The California State Department of Education sponsored a workshop 
on alternative modes of assessment. The CSDE consuTtant tailored 
the sessions around basic skills competencies and performance 
indicators developed by the elementary consortium. 

• The consortium paid a consultant to pr'ovide training on holistic/ 
analytic -scoring of writing samples for district personnel.^ 

• The Santa Clara County AB 65 Special Education Consorti um gave 
a presentation on how it developed its assessment framework. 

• ^ cassette tape of a presentation given to the secondary consor- 
tium and its accompanying paper were'made available to e^ich of 
the member elementary districts. The pVesentor, a local profes* 
'sor and researcher, had developed an innovative approach to- 
improving the effectiveness of basic sk^fTTs instruction. 

Budgeting . The 1980-81 budget was se^ at $36,250; $10,000 already 

existed in carry over from the previous year, and the county office 

was able to provide $4,500 in returned Title IV-B money. Th^t left 

a totjal contribution of $870 for each of the 25 member'districts. ' * 

At the August 1980 meeting," the^'^group discuss^ed the option (Jf 

imiting its goals in an effort to reduce the financial contribution 

each district would have to make. They agreed, however, that prior- 

ities should remain as they were and "that the cheapest way to develop 

the assessment was through the consortium." ' 

The projected' bart^^et for i981-'^totaled $30,500. The county office 

was, able to contribute $6,000 toward these costs* Each member district 

was asked to contribute $850 but to allocate $1,000 in case thereon- ' 

sortium needed additional funds by the *en^"aNfe+^^ year. Four priorities 

were established for the development of products during 1981-82: 



First priority - Develop, an item- scoring guide for writing 
samples from- the fourth ^rade througl^^ high school with' an - 
accompanying teaching strategy and workshop^. The secondary 
consortium woulcl contribute half of the developmental costs 
of this material . 

: , i 

Second priority - Develop model workshops based on the AIM 

* manual for administering the proficiency assessment program 

* and update- the manual as needed. Here again the secondary 
consortium was willing to contribute half of this expense.. 

Third priority - Develop items for fifth- and seventh-g'rade 
assessment packages, field test the i,tem data, and check for 
cultural bias.' • ' ^ ' 

Fourth' priority - Prepare a companiofi tjo the AIM.. manual that 
links the proficiency asse'ssment program with curricular 
impl ications\ The secondary consortium would p,ay half of f,^.^- 
the developmental costs here as well. 

y 

Local Ownership 

In a state like California, with its strong norms of local 

A 

control, the issue of giving up district autonomy in a collaborative 
effort Cctn influence consortium .development; In ^his case, however, 
there is little evidence that district tutononiy served as a barrier* 
A number of factors may explain this tendency. y/. 

J 

* The county office had already established a precedent for dis- 
trict, co'operation^hrougti consortia. Many cff the districts 
were better able to weigh the costs and benefits of membership 
in the AB 65 Elementary Consartfum because of their prior 
experience with such g«aups. 

The legislation gave di stricts' enough time to develop a pro- 
ficie^Tcy assessment process on their own if th'ey chose to* 
This leeway afforded them the option of participating in the 
consqrtium without being completely vulnerable if it was unpro-^ 
ductive or unsuccessful. Even if a district discontinued jiiem-^ 
benship or the consorti um^ was dissolved, there v*ould' still be 
time to meet the mandate. 



The risks were small compared to the potential benefits for a 
district. At inost, it might los^ a few thousand -dollars and 
some staff time. In return, it stood to obtain all of the 
materials and training necessary to meet tha mandate, along 
with complete assessment .packages and processes for grades ^ 
4-8. It would be quite a bargain if the consortium succeeded. 
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• Because 6f district concern about obtaining assessment materials 
that were reflective of thei/r own standards, philosophies, and 
■curricuj3> the consortium created flexible, modular products* 
Perfonnance indicators and item banks for each grade level allowed 
districts to develop assessment packages that met their unique 
needs* There was no^one test that all of *the consortium members 
agreed to use, just as there was no one sat of performance standards** 

The County Office. Role . -^v . / ' 

^ Credit should be ^given to the Office |f the Santa Clara Super- 
intendent-^ Schools, which provided coYvs^tant, unwavering impetus 
and leadership for the AB 65 Elementary Consortiun). This county 
office is remarkable in its commitment to consortia as an effective 
way of hel pi ng /districts meet mandates and accomplish educational 
objectives. But this commitment provides more than just lip service 
in favor 0/ the concept of collaboration. Itemized- here are some of 
the ways tKe county office supported the consortium throughout its 
existence: * , . <^ • 

• Initiallif, the county office called the meetings for t;he purpose - 
of exploring the option of an AB 65 elementary consortium. 
Throughout the life of the consortium, meetings have been held 

at the county office facility >. and office and storage space have . 
been provided tq the consortium. 

' • At^least one professional staff member on the county payroll has 
^ * served as consortium coordinator from the outset,. Frequently 

more than one county office consultant has Qontributecf to con- ^ " 
sortium projects. The current consortium coordinator has been a 
panticularly effective leader, .keeping the group on task, chairing 
meetings skillfully^ distributing comprehensive written communica- 
tions to member districts, and sensing wl\ert changes need to be made 

• or imnWf^iate action taken. Certainly thi credibility and' eXpertjse 
of the current coordincitor have helped the consdrtium to remain as 
well-organized and productive as it has been. ^ 

• Another positive influence was provided by the secondary consortium. 
Already functioning when the elementary Consortium was proposed, 

» it continued to nurture b supportive, v6ollegial relationship with . 
y the elementary consortium. The two consortia shared costs for 
'/ product development and co-sponsored workshops. The coordinators 

of both consortia work together frequently at the county office, - / 
increasing the possibi-lity of collaboration between the two groups. 
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t Finally, the significant finanCfa^" investment that the county 
office was yrflling to make contributed a gfeat deal toward product 
development and the implementation of priorities* Not only were 
large sums of money ma,de available annually for the consortium 
budget, but the^county office was' also willing to support con- 

* . siderable professional staff costs. 



Entrepreneurial Activity 

♦ When finished products began appearing in summer 1979, the 
liponsortium -understood that i^t had something of value to school dis- 
tKicts* Since th^n, a variety^f materials and manuals copyrighted 
by the consortium have "^een made available for purchase by other dis- 
tricts throughout the ^ate of California* Although the consortium* 
is not legally able to sell, its products for a profit, they can jus- 
tify charging more than printing costs,, provided that the additional 
funds are reinvested in further developmental efforts. 

Some of the consortium's products are the results of hundreds of 
hours of time voluntarily contributed by task force members. Consult- 
ants paid by the consortiijm have also worked on a .nunlber of products. 
The end result is a collection of highly useful materials, thoroughly 
concepl(ualized and thoughtfully written. These materials 'would be 
i nvaluablVr^Cime-saving additions to the resources of many, school 
districts in California. 

^ The consortium is currently concerning itself with the entrepre- 
neurial questions of oopyright, marketing, and promotion. If anything 
the members seem to place too little value on the time and expertise 
they have invested in. their extensive developmental effort. Maybe 
trtfey need more time to discover how worthwhile the results of their 
work really are.. ^ . ^ 
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Was It Worth the Effort? - 

Perhaps the best way to answer tfiis question is' to let the con- 

sortium members speak for themselves, a Here are comments from the 

1979-80 evaluation conducted within the consortium, 

"We^are all new to this process. It is important that 
we share ideas, plans, and materials," ^ 

"It's the only way we can afford to get the job done." • 

* • * 

"Too. many of us are content to let someohe else do the 
work. WeWe got to assume mpre responsibility." 

"Constantly be alert to and squelch temptation to' repli- 
cate work already done satisfactorily elsewhere." 

"I think the eleifientary consortium is extremely valuable 
,and I do'n't want to see it * reduced' in any way- We all 
^ need to reexamine our commitment and then do something 
to act upon that commitment. Yea team, le"F"s go!" 

In Summary • <^ ^ 

This case study of the Santa Clara County AB 65 Elementary Con-' 

m sortium documents the development of a collaborative effort among a 

' number of school districts and an intermedial;^ serv>ce agency. It 

traces the major events that occurred within this interorganizational 

arrangement, where the members went for serv-ice and information, and 

how this knowledge was used. The costs and b.enefits, responsibilities 

and rewards of consortium- activity emerged as the case unfolded. What 

can be learned from the -experience of the AB^"65 Elementary Consortium? 

• Interorganizational arrangements, like organizations themselves, 
are constantly evolving. Sometimes this evolution takes the 
group down detours; other times it provides a direct rout-e to 
effective cooperation. » ' ^ 

i Interorganizational arrangements follow predictable s1;ages of 
development. Initially they will probably have vague goats, 
fluid participation o^ members, 'and an ambiguous plan for 
moving ahead. Trial-and-error activity can be expected during 
the early months, if not longer. This is followed by a more 



stable period with clearer objectives and directed 'activity. 
Such changes are normal and healthy.- 

A sizable investment of tinje, ^eser^,_^and money is necessary if 
an lOA is*to repiain vital and |FT^ttoctTve. Formal membership . 
and financial contributions must be strengthened by more 
infonnal investments of expertise and creativity on the part' * 
of the representatives themselves. 

CollabG^ratives provide a Hrger pool of resources to be used 
for obtaining outside consultants, services, arid information. 
This knowledge and skill benefits all the member organizations, 
increasing the impact of the investment. 



organizaticrfTs can enhance the quality of their performance in 
the consortium. Other means of communicating current informa- 
tion to these indiv«iduals are also necessary to avoid confu- 
siorr, duplication of effort, and unnecessary wor^. 

A strong organizational' and individy^al leader contributes sig- 
nificantly to the success of a collaborative effort. Having * ^ 
someone who can coordifiate a multil!ujie of activities and link- 
ages and who has the support of his>or her employer is essential 
to the-«iccess of a consortium. 




representatives of member 
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Data itollection Procedures 

Pata collected for this case study were triangulated by using the 
fol/l owing three techniques: r ' ' 

1. Interviews were conducted with county office staff and con- 
sfortium me^ibers. Respondent comments about th^onsorti urn' s develop- 

■ / mental processes and anecdotes about tfie collaborative involvement of 

/ • - ^ 

members established the overall framework for the case. 

2. Two researchers attended an all-day consortium meeting held 

at the end of the 1980-81 school year. Their observations of interaction 
and-discussion among consortium members provided further data for the 
case description. * ' ' - 

3. All of the archival documentation of consortium activities 
and transactions was reviewed. Information from meeting minutes, in- 
ternal and e)^ternal correspondence, budgets, evaluations, an^reports 
contributed a considerable amount of data to the case study. 
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C.orisortium Membership 

Figure *1 summarizes information about the members of the AB 6S 
Elementary Consortium as of summer 1981. A number of observat'ions* 
can be derived from the data: . . - ^ 

• There are 10 districts serving K-8 and 13 serving K-12. In 
addition, one university and one county office are in the 
consortium, which has a total of 25 members., 

• Of the 23 school districts, 15 are located within Santa Clara 
County and 8 are outside the county. 

• Over one third (9) of^the member districts have fewer than 10 
schools, and another third (8) have 10-19 schools. Three dis- 
tricts have 20-29 schools, one has 30-39 schools, and'two have ^ " 
over 50 schools* 



The above configuration correlates with student population 
figures, summarized below: 

Number of 

Enrollment Districts 

to 4,999 9 

5,000-9,999 8 

10,000-14,999 3 

15,000-19,999 • 1 ;. 

20,000-29,999 0 

30,000+ • 2 

These districts are predominantly medium-sized, suburban or 
rural, lacated in the southern" part of the San Franci.sco Bay ' 
Area and in the farming communities a>;ound San Jose. Members 
from outside the county are mostly from small communities. 
Two of the unified districtVnqt in Santa Clara County serve 
Marge rural areas and thus. have more schools* 
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Figure 1 
' Membership 
Santa Clara County 
AP 65 Elementary Consortium 
Summep, 1981 



Organization 



Location 



In 

Santa Clara Number' of 
County?, Schools and 
Yes No Grade CeVels 



Year ^ 
^ " Joined 
Enroll- 1;he 
ment ' " Consortium 



Albany Unifted ■ 

Cambrian Elementary* 

Cupertino Union ' ' 

Davis Unified 

Evergreen Elementary 

'Fairfield-Suisun Unified^ 

Frank! in-McKinley Elementary 

Gil rDy^ Unified . 

Los Altos Elementary * - * 

Milpitas, Unified • < 

MoreTand Elementary ^ 

Morgan Hill Unified 

Mt* Diablo jJnified 

Parlo Alto U,nifi^ / 
' San yo^e Unified 

%ix\ Lorenzo ^Val ffey Unified* 

Santa CI ar^ Unified -> 
' Saratoga Union ' ; 
^ Scptts yal ley Union * 

Sunnyvale Elementary : 

Travis Unified > 
'Vacaville' Unified 

Whisman Elementary 
^ Santa Clara County Office 
* San Francisco State University 



Albany 




X 


. 7 


k- 


■12 


2,155 


79 


San Jose ^ 


X 




6- 




•8 


2,423 


78 


Cupertino 


X 




30 


K- 


•8 


14,252 


78 


Davis. ' ' 




X 


~ 10 


K- 


•12 


j.348" 


80 


San Jose 


'X 




10 


K- 


■8 


siM92 


.78 


Fairfield 




•x 


24 


K- 


•12 


'^7337 


81 


S<in Jose • • 


X 




- 11 




:8 


6 -,847 


79 


Gilroy. , 


'X 




>11 


K- 


•12 \ 


6,774"/ 


; :78 


Los Altds 


X 




8 


K- 


•8 


3,094 


78 


MilpitasX 


"x 




15 


K- 


•12 


8,340 


78 


San Jose \ 


X 




8 


K- 


•8 . 


4,423 


78 


Morgan Hil iV^ 






16 


K- 


■12 


8,471 


79 


Concord / 




X 


52 


K- 


•12 


32,632 


80 


Palo AUo 


X 




22 


K- 


•12 


10,123 


78 


San Jose * 


X . 




54 


K- 


■12 


36,182 


79 


Ben Lomond 




X 


5 


K- 


12 


3,250 


80 


Santa Clara 


X 




24 


K- 


12 


16,187 


78 


Saratoga 


X , 




.5 


K- 


8 


2,714 


. 78 


Scotts*»Val ley 




X 


3 


K- 


8 ' 


1,346 


79 


Sunnyvale 


X 




13 


K- 


8 


5,804 


78 


Travis AFB 




X f 




K- 


12 


2,885 


79 


Vacavil le 










K- 


12 


8,655 


81 


Mountain View 


X 








K- 


8 


l,'l83 


79 


San Jose 


X 














78 


Saa Frdficisco 




X 










81 



• 1/ 



Total Number of Members = 25 
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Changes in Consortium Member^sh'ip , - ' ' ' 

Me(nbership in the "consortium has not remained stajj^c, as ftidicated 
by Figure '2* Wfthin- the first year^of its existence, consortium mem- 
hership doubled, jiimping from 12 in December 1978 to 27 in December 
■1979. By May 1980, membership was at^its peak of 33* Since then the 
numbers have*decl1ned to tfie current total of 25, Qf th^ members that ' 
have dropped out; four joined in 1978, nine joined in 1979, and one 
joiiied in 1980* 

A correlation seems to exist between the nine districts that 
joined in 1979 and the membership high of 33 in May 1980* This could 
be interpreted as a rush to join the consortium after its impressive 
assortment of products was unvej'led in the fall of 79* After the§e 
new districts were. involved for a year or two, they discontinued mem-' 
bership. this left almost the same nucleus of distric.ts that ha^ 
participated in the consortium since it's inceptio.n. Those tl\at chose 
to collaborate from the beginning seem to have exhibited greater 
longevity than the ones that initially held- back'' from joining. 
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Figure 2 

Changes in Consortium Membership 

^Consortium Membership Totals 

Date Number of Mefflbers 

December 1978 ^: 12 

February 1979 ' ' 16 

December 1979< 27 
May 1980 ' 33 

August 1980 * . 30 
June 1981 ^ ' 25 . 



Previous P^ticipants in the Consortium 
that Are No Longer Members" 

Organization . ^ Year Joined ^ 

Alum Rock Union Elementary J8 > 

Mt. Pleasant Elen\entary * 78 

Mountain View Elementary . 78 

Orchard Elementary . 78 

Berryessa Union Elementary. 79 

Campbell Union Elementary " 79 

Lakeside Joint Elementary 79 

Loma Prieta Joint Uni^n Elementary ' ^ 79^ 

Los Gatos Union Elementary 79 

Luther -Burbank Elementary . 79 

Montebello Elementary " 79 

Oak Grove Elementary ^ * 79 

'Union Elementary^ ' 79 

Parlier. Unified 80 
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OUTCOMES OF THE 
AB-.65 ELEMENTARY CONSORTIUM 



i 



Products \ .* , ' \ 



Administratpr^s Information Manual r-Tianagj^g Proficiency Assessment s 
Office of*'* the Santa' Clara County Superintendent of Schools, ^ 
Elementary/Secondary Consortium^ 1981. ^ ' 

Articulation oV Basic. CompetepcieSy^Grades 4-Secondary * Office of 
the Santa Clara County Superintendent of Schools, Elementary/ 
Secondary Consortium^ 1981."' 

Evaluating Wciting.SampTes, Grade^S . Qffice of the Santa Clara County 
' Superintendent of Schools, AB 6S Elegientary Consortium, 1981. 

Item Bank for Mathematics, Reailing-and Writing, tirade 4 * Office of 
the Santd -Clara Colinty: Supe^ntendent of SchQols, AB 65 Elementary 
^l:onsortium,"1981.''^- ' , I: I . ' " ^ 

Item Bank for Mathema^css, Reading .ejndx^ri ting, Grade 6 . Office of the 
Santa .Clara ^County jisuperfntend^nt of Schools, AB' 65 Elementary Con-* 
. s6rtium, 1980. A'' ^ . - 



Item Bank for •Matheitiffeli^^^ and Writing, Grade 8 . Omce. of the 

Santa Clara Countjj ,Su'permsndent K)f>Schoo ls,-.AB b;? Elementary .Con- 
sortium', 19 8p^—^ 

Model Tek'IlesigV Grade 6 Mkbemati'cs Basic Skills Test . ' Office of 
the Santaf^C-lara'^i^nty Superintendent of Schools, AB b5 Elementary 
Consortium, 198oI ^/ " ' ' > • . " 

Proficiency As?e^ent Spec^f^i cat ions Samples: Grade 4 . Office 'of 
the Sant,a Clara Ceunty Superintendent of Schools, AB 65 Elementary 
: Consortium, 1981v . • • '. ' ■ 

Proficiency Assessmfenf Specif icati9ns Samples: Grade:6 . Office of 
.1 tJae Santa &lara Bounty Superintendent of Schools, AB 65 ^Elementary 
Consortium, 1979.^ ' y; '-v 

Proficiency Assessment Specifications Samples: Gradfe 8 . Office pf- 
^he 5ar^a Clara County Superintendent of Schools, AB 65 Elementary 
Cemsot^ffum, 1981. ^ ■ . * 
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Information * ' \ 

June\1978 -.paper transparency masters and pages from the 
lameda Pr/ocess^ Handbpok —mailed .\ ' * , , ^ 

luneH978 '-\ Competency st8|J:ements in all three subject areas 
developed by the consortium— mailed. 

'June 19^ - Paired-weighting prioritization charts for 
^selecting test Items— mailed. 

January 1979 ^ List of companies providing test scoring ser- 
vi^be^rdistrlbuted at consortium meeting. * 

,April^l979 - Sample's of local board policies and reciprocity 
agj^eements developed by LEAs-' f or proficiency assessment— mailed and ' 
then discussed at the April meeting. 

- May 1980 - List of consultants to train district staff in.ho^ 
J istic/analytic scoring of writing saniples--di stributed at meeting. 

• November 1980 - Samples of management systems developed by LEAs 
to'implement .the proficiency assessment— distp4buted at training. 

May 1981 - Copies of a 'cassette tape of a , presentation and a 
paper, by a local researcher on improving the basic skil 1 s--diseussed 
at meeting and sent by mail. - r 

/' Training - Workshops and Conferences ^ 

JantUary 1979 - Workshop on 'cipplying the RascH process to ana- 
lyze item data. . * 

April. 1979 - Representatives sent to CSDE-sponsored Train.ing 
^ Program 'for Competency Assessment. 

' ^ November 1979 - Workshop on holistic/analytic scoring of field 

test writing samples. 

' January 1980 - Passing score workshop to help LEAs select 
proficiency standards for the assessment. 

May 1980 - CSDE-sponsored a workshop on alternative modes of ^ 
/ assessment^ tailored specifically to consortium needs. 

May 1980 - Presentation by the coordinator of* the AB 65>Special 
Education Consortium' gave a presentation ^n how the members developed 
their assessment framework. 
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Sha^red Services and Facilities * 

November 1979 - Cooperative efforts begun among LEAs for pre- 
paring, printing, and scortng their assessments* 

AlVconsortium meetings were held at the Office of the Santa 
Clara County Superintendent of Schools* 



Task Forces 

Dates in 
/ Existence 

October 1977 



November 1978- 
March 1979 



January 1980 



January 1980- 
March 1980 



April 1980- 
May 1980 



Name 

Elementary Districts 
Steering Committee 

Readiri^ Writing, and 
Math Task Forces 



Model Tests in 
Reading, Writing, 
and Matfi''^^ ^ 

Item Bank Task Force 



V- 



Purpose -- 



Priorities Task 
Force 



Recommend initial step.s for 
establishing the consortium 

Revise competency statements 
for each basic skill area; 

Refine competencies and 
performance indicators 

Review and finalize model 
tests in all three skill 
areas ^ f 



sso*!^ 



Review item banks*"xlevel opec 
by Northwest Evaluation As< 
elation and recommend* whether 
or not th'e consortium shouldi ^ 
purchase them *^ 



Recommend and formalize a 
process for LEAs^ to use item 
banks purchased from Northwest 
Eval uat ion' Association 

Develop a plan, for accomplish- 
ing all consortium priorities- 
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I The Mandated/Freestahdifig Arrangement ' ' 

The study of interorganizational arrangements conducted previ- 
ously by the Educational Dissemination Studies Program suggested a 
two-dimensional classification system for coll aboratives. One factor 
i^ the matrix was th^ school improvement effort, which could^be 
mandated, enabled, or freestanding. The second dimension was the 
arrangenent itself, which'^Td also be mandated,- enabled, or free- 
standing. Each lOA included in the study was categorized into one . 
of the nine cells in the matrix, depending on the school improvement 
effort associated with the arangenent and the catalyst for the 
establishment of the collaborative. 

The AB 65 Elementary Consortium, which was one of the arrange- 
ments included in the earlier study, can be classified as mandated/ 
freestanding. The school improvement effort it addresses is mandated 
by the AB 65 requirement that elementary schools adopt proficiency 
standards and tests. But the arrangement itself is freestanding* It 
was established voluntarily by interested organizations--not mandated 
or enabled by an outside agency or funding source. 

What conclusions can be reached about such mandated/freestanding 
arrangements? The first one, which is also the most obvious, is that 
a mandated innovation or educational change can provide a powerful 
impetus for cooperation among school districts.' Member orgarvizations 
knew that they were required to set proficiency standards, develop 
alsessment^ instruments, and administer them within a given length of 
time* Mhbther they really wanted to invest time and resources in the 



effort was a moot pointy they had' no choice but to meet the mandate. 
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Essentially, there were two options for meeting the mandate open 
to sjchool districts. They could work alone, assuring £hat the end 
product was specificaTly targeted to their schools' needSr Or they 
could join fortes with others, §|iarjng some of the* investment* of time' 
and resources needed to fulfill the requirements. The trade-off for 
this potential cost-cutting might be products and processes not as 
closely aligned with individual district needs and programs. 

■ The formation of the arrangement itself was nei'ther mandati^d nor* 
enabled with external funding. Consequently, any collaborati ve-^means 
of meeting the mandate had to be " sup(ported with resources contributed 
by member organizations. There were a number of risks inherent in 
such ^n approach. 

• First was the risk of entering into a collectivity rather than 
^ remaining autonomous* Sometimes cooperative efforts fail mis- 
eraTDly, 1;he victims of indirection, disorganization, second- 
class. status, and llack of enthusiasm. Member ocganizations may 
forfeit their unitary decision power and organizational control ^ 
to the consortium as a whole. 

t Second, the deadline for compliance with the mandate was fixed. 
By joining the consortium, districts were risking the time they 
could otherwise be spending working alone on the proficiency 
assessment requirements. If the consortium failed and the 
districts eventually hacl to function independently, they would 
have less time to complete tasks than they would have had 
otherwise. 

t Third, the investment .of resources aruUstaff time was a risk. 
Although initially the-consortium requfr^ low to mdderate 

- contributions of money and effort from the districts, member- 
ship in. the consortium eventually exacted a greater toll. 
Annual financial contributions nearly doubled, and each rep- 
resentative is now required to serve on at least ofte task' 
force. The opportunity costs of such involvement- -the other - 
ways the money might have been u^ed or the other activities in 
which the representative would otherwise have been involved-- 
represent another kind of risk. 
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^ Final ly,' consortium members Visked lo^ of prestige when they ^ ^ 
decided^to join a collaborative effort* There were other dis- \ 
tricts in the county that chose not to participate. They would \ 
be watching the consortium to determine whether or not it sue- 
'ceeded. Decrsion makers who adopted a stance In favoj of 
* collaboration wou4rd be judged by tffeHr'non pa"rticipdting peers^- 
albeit covertly and implicitly. The consortium symbolically 
represented the value of sharea resources and expertise, and that 
value was at risk when the lOA was formed. 

^ > 

*Ultimately the risks paid off. The consortium was far more 
^productive than any of its member organizatiojis had hoped. Strong 
bonds among the districts were formed as their staffs worked together 
toward common goals. And the AB65 mandate was met. 
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Organizing the Consortium 

"Consortium" is defined in the dictipnar^' as fellowship;' part- 
nership." To consort fs "to keep company ;5 to associate; to accord; 
harmonize*^ (Webster's New Collegiate Dictionary , -1961, p> 178). 

The spirit of. these definitions is evident in the AB 65 Elemen-^ 
tary Consortium* Rather than being a group bound by rigid rules, it 
is bound by fellowship* A formal agreement among the member organiza- 
tions establishes their minimum financial and service commitment. 
But the results of tffe group effort extend far beyond these minimums* 
Because of the harmony and good will that have emerged, the consortium 
has. provided more than jus^ compliance wi^h California's proficiency 
assessment^mandate. ' , 

On the following pages, an organizational document of the con- 
sortium is reprinted* It opens with its own oper'ationa-1 definition 
of a consortium: "a structure for providing a representative process 
for districts to co'operati vely accomplish tasks based on a comhiQn^ 
and critical need*" A Work Agreement is included, along with a page 

4 

listing principles for success, start-up, and the consortium process* 

A flow chart then depicts this process in greater detail. 

Some highlights from these material s- bear noting: 

t The county office contributes 'the orgahizational leadership 
for the consortium, providing a 'fiscal' agent, a coordinator, 
and consultant assistance*- 

t Products for the year are specified in the Work Agreement, as 
are the districts' monetary and professional contributions* 

• Scaring and cooperating 'are emphasized, as^evidepced by the 
numerous task forces and the prerogative the members have to' 
make all major decisions. 

' i ■ ■ ' 
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• The consortium receives input from three groups via the 

» district representatives: a professional (faculty) advisory 
coflimitteej* a-community advisopy committee; and administrators 
from each 'district. ^ ' * / 

• The work of the consortium is performed by task forces, the 
coordinator,. and consultants. 

#* 

• Ultimately, the board of education in each member district has 
the option of accepting, rejecting, modifying, or individual- 
izing consortium products. 

On the next five pages are copies of organizationaj materials used 
for consortium start-up. 



GLENN W. HOFFMANN, SUPERINTENDENT ' 
100 Siiypofi Drive * S«n Jose. Caitfofnia 951 10 
299-2441 Area Codf 408 

jOFFICE of the SANTA CLARA COUNTY SUPERINTENDENT OF SCHOOLS | 

Vocational Education and Guidance 
408/299-3632 
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THE MAKINGS OF A CONSORTIUM 

by • , : . 

Dale Burklund, .Ed.D 
'* " John Patterson, Ph.D ^ 

' 4 

Definition: Webster - Consort; one who shares a comnon lot 

Consortium; an association, society 

Operational - A consortium is a structure for ptoviding a representative 
process fcrr-districts to cooperatively accomplish tasks 
based on a common and critical need. 
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^ffliffllfflfr7l1^|^ « ' An Cquaf Opportunity Employar 



AB 65 ELEMENlARY CONSORTIUM ' ^ 

ACREEMESl • ■ 

This Is an agr-eement between the Santa CJara County Superintendent of Schools 

(Superintendent) and Par liclpatinp Schoo] Districts (identified in Paragrapli 2), 

* 

in the Santa Clara-County AB 65 Elpinentary Consortiun relatinji.to the coordination 
of the iirp] ementat ion of the AE 63 *'Pulf)il Progress/' 

1. Duties of Supgri^&ejdent « Superintendent sha]J: peYfonn the duties of ' 
Fiscal ApeM for the 5anta Clara County AB 65 El en-erftar y Consortiur., co- 
ordinate the efforts of the pa rt ic ipa t in^> districts in the development 
o: and refining of the mod^] assessment prccedur^rs and assessment pack- 
ace. Providt consultant assistance in developing assessment materials 
a Nclicatint a-s^ess-eni procedures. 

' Products that wi]] be provided : 

. ^ ^. Refined conpetency statements that are dewloped b> participating 

school districts in the area^ of reading, inath and writing. 

B. . Refined performance indicators (objectives) f6r each competency 

' statement . 

C. Refined^ test iters. for each performance indicator. ^ ^ 

D. Iter, data - P values and biserials - for each iter.. 

E. A inodel Ad- ini s t ra tor ' s Manual for adr ini s t rat ion of the test developed 
fror the inodel assessment package. 

F. Model board policy statements for adopting competencies and standards. 

G. A model scoring procedure * for writing samples. 

H. .>lodel fomats for communicating, reporting a^d recording test results-. 

I. An Item bank coded according to competency and performance indicator 
to provide efficiency for developing tests and alternative forms. 

2. Obligation of District. " School District 

«hall pay to Superintendent a'' «um not to exceed Five Hundred Dollars 
($500.00) on or before O^Tobcr 1, 1979. 

3. Terjn. This «grccncnt »hall coroencc, on July 1 , 1979, and terminate on 
June 30, 1980. , 

' • . 53 - ' 



Coordinating Congnlttee > Each PartlclTatlnp Dlsti^ict shall deslfrna te^one 
Individual to be a member of a coordinating: coTmriittee. The coordinating >^ 
comnittee shall have the following duties- 

A. Decide what activities shall be undertaken by the Participating Dis-/ 
tricts; 

h\ ■ Decide'vhai inaterials shall be purchased bv the Participa tin^ Di stri^*ts; 
C. Decide what shall be printed or reproduced bv the Participating- Die- 

trrcts; ^' 
h. Decide when and how consultant services shall be provided; and 
I. 51. ill i^e responsible for developre'-^t and adrinistratio- of bvdf.:\. 



i:: VITNISS W.LhZO-T , the parties hereto have executed this agreement on^ 
; , 1979. 



SCHOOL DJ STRICT 



By 



PERlKTENbENI 



SANTA CLARA COUNTY SUPERIKTENDENT OF SCHOOLS 

By 

Chief Deputy Superintendent 



JP':cs 
6/15/79 
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Principles 'for Success: , ' - - • 

1. / The Consortium must be found^d on a common 'and critical need that can be met 
** more' effectively and efficiently through districts sharing and cooperating. 

2. Consortium members make all major decisions. ^ 

3. All member districjts contribute money to achieve .Consortium goals. 

A. .Ali member districts contribute personnel to achieve Consortiutn goals. 



5. Consortium membership e^Kb-lishes the budget and decides on allocation Q,f 
financial resources. 

6. A work agreement (not a contract) specifies the task to be accomplished and 
the related district and^oordination responsibilities for completing the 
task. Doesn*t tie the hands of tha district administration and boardi*.' 

Start Up: 

!• Identify a common concern ^and validate it by checking with districts. 

2. ,Call a meeting af district xepre septa tiv'efs in 'regard tothe common concern.' 

3. * Determine the extent to whichLthe need is common, critical and appropriate 

forf* ^dis&rict, cooperation. 

Make decision to organize Coprortxum. 

and desired outcomes into a consonrtium work agreement that 
SsYricC and coordination responsibilities. 

jlrry out charge of the Consortium. * ^ 

Consortium Proc^ssr ^ . 

•1. Action decision of Consortium. 

2. Development by^ask Force c^^artJj^fior and consult^ant , 

f 

3. Review by Consortium^ 
4'. FinalifW^leve 





'X' ^ 




5. Disseminate lo Consortium 



'NOTE: See flow ch^ for more 'detail^ on consorrium process. 
n6TE: • Se^ flow chart for more detail on consortium proc^^F>s^ 



Note: Secondary Consortiun has JA member* districts, 
' Elementary Consortium has 26 member dis-trttts 
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